The Glorious Ones wallow in their positions as elders, so suggest to them that they "exert themselves" to take the lead in the art of "trolley zombieism."
(Hebrews 13:7) "Remember those who are taking the lead among you....."
(Hebrews 13:17) "Be obedient to those who are taking the lead among you...."
Regardless of when you stand down as a mini-servant, the reaction from your family is definitely going to be the same, so why prolong your agony?
Bite the bullet, and save yourself having to provide different reasons for quitting pioneering and then quitting as an M.S. Simply give one answer for both - "I'm having to deal with private & personal issues - thanks for your concern."